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Multiscale  Autoregressive  Processes,  Part  II:  Lattice 
Structures  for  Whitening  and  Modeling 

Michele  Basseville.  Albert  Betivenisle,  Fellow.  lEFF.  anti  Alan  S.  Willsky,  Fellow.  IFhi. 


.AAsfraff— In  pari  I  of  Ihis  two-part  paper  we  introduced  a 
class  of  st<K'hastic  processes  defined  on  dyadic  homogenous 
trees.  The  motivation  for  the  study  of  these  processes  comes 
from  our  desire  to  develop  a  theory  for  multiresolulion  descrip¬ 
tions  of  stochastic  processes  in  one  and  multiple  dimensions 
based  on  the  idea  underlying  the  recently  introduced  theory  of 
wavelet  transforms.  In  part  I  we  described  how  this  objective 
leads  to  the  study  of  processes  on  trees  and  began  the  devel¬ 
opment  of  a  theory  of  autoregressive  (AR)  models  for  isotropic 
processes  on  trees.  In  this  second  part  we  complete  that  inves¬ 
tigation  by  developing  lattice  structures  for  the  whitening  and 
modeling  of  isotropic  processes  on  trees.  We  also  present  a  re¬ 
sult  relating  the  stability  properties  of  these  models  to  the  re¬ 
flection  coefficient  sequence  introduced  in  part  I.  In  addition, 
this  framework  allows  us  to  obtain  a  detaiied  analysis  of  the 
Wold  decomposition  of  processes  on  trees.  One  interesting  as¬ 
pect  of  Ihis  is  that  there  is  a  significantly  larger  class  of  singular 
processes  on  dyadic  trees  than  on  the  integers. 


I.  Introduchon 

N  part  111]  of  this  two-part  paper  we  introduced  the 
class  of  isotropic  processes  on  homogeneous  dyadic 
trees,  and  began  the  analysis  of  the  corresponding  clas: 
of  autoregressive  (AR)  processes.  As  developed  in  jll. 
the  motivation  for  the  study  of  these  processes  comes  fro.n 
our  desire  to  provide  a  statistical  framework  for  multi¬ 
scale  signal  processing  based  on  the  structure  of  the  re¬ 
cently  introduced  class  of  wavelet  transforms  [7|, 

in  [1|.  we  introduced  and  described  the  geometry  of 
homogeneous  dyadic  trees  and  a  natural  notion  of  “pa.st'‘ 
and  "future."  where  a  move  into  the  "past"  ("future") 
corresponds  to  moving  to  a  coarser  (finer)  scale  descrip¬ 
tion  of  a  signal.  The  class  of  isotropic  processes  on  trees 
was  also  introduced  in  llj.  and,  with  our  notions  of  past 
and  future,  we  defined  the  class  of  autoregressive  (AR) 
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isotropic  processes  and  began  the  study  id  (heir  paramc 
tri/.alion.  The  major  result  of  [ ! !  was  m  establish  that  the 
only  suitable  parametri/.ation  of  isotropic  processes  on  the 
dyadic  tree  is  obtained  v  ia  reflection  eoelheienis  follow 
ing  the  gcnerali/ation  of  the  Sehur  Lev  inson  parametri 
zation  techniques  for  usual  time  senes.  In  this  second  pan. 
we  further  investigate  the  propcnics  of  isotropic  pro¬ 
cesses  in  terms  of  their  reflection  eoefheients.  In  partic¬ 
ular.  in  this  paper  we  use  the  analysis  in  1 1 1  both  to  eon- 
.struet  lattice  structures  for  the  whitening  and  modeling  of 
AR  processes  on  dyadic  trees  ind  to  analy  ze  in  detail  these 
models  and  the  properties  of  isotropic  pri'cesses 

This  paper  relies  heavily  on  the  framework  am!  results 
of  1 1 1.  and  we  refer  the  reader  to  that  paper  for  reference 
In  the  ne.xt  seetiivn  we  provide  a  brief  summary  ol  some 
of  the  basic  notation  and  constructs  from  |!|.  Section  HI 
is  then  devoted  to  the  presentation  of  whitening  and  mod¬ 
eling  filters  for  AR  isotropic  processes.  L’nni>rma!ized  as 
well  as  normalized  versions  of  these  filters  arc  given,  In 
particular,  the  nonnalized  modeling  tiller  appears  as  a  tree 
.'.tnictured  scattering  .system.  Then,  in  Section  IV.  several 
properties  of  isotropic  processes  arc  analyzed  in  terms  of 
the  reflection  coeflieient  .ccquenee.  Specifically,  AR  pro¬ 
cesses  are  eharaeterized  as  being  the  processes  with  only 
finitely  many  nonzero  reflection  eoefiieicnts.  purely  non- 
deienninistie  processes  are  characterized  in  a  fairly  sim¬ 
ple  way.  a  stability  result  for  the  modeling  filters  is  pre¬ 
sented.  and  finally  it  is  shown  that  every  hnite  set  of 
reflection  eoeffieients  properly  define  a  unique  .AR  pro¬ 
cess  provided  they  belong  to  an  easily  defined  domain. 
Finally,  future  issues,  both  practical  and  theoretical,  are 
discussed  in  the  conclusion.  Many  of  the  results  presented 
here,  while  paralleling  those  for  time  series,  arc  more 
complex  than  their  time  series  counterparts  due  tt'  the  sig¬ 
nificant  increase  in  geometric  complexity  in  going  from  a 
homogeneous  tree  of  order  1,  i.e..  the  usual  disercte-time 
index  set.  to  the  dyadic  tree,  which  is  of  order  2.  For 
example,  as  introduced  in  | !  |  and  described  in  detail  m 
Section  IV.  the  prediction  error  processes  associated  with 
lattice  filters  on  dyadic  trees  are  vector  priieesses  of  di¬ 
mension  that  increases  with  filter  order 

II,  DV'VDIC  Tri  I  s,  IsotKofif  Proc  1  SSI  s.  vmv 
PRt.DIC  I  ION  HrKOR  RiCt  RSIOVS 
In  ihis  section  we  review  some  of  the  basic  eoneepts 
and  constructs  described  in  1 1 1.  W'c  refer  the  reader  to  1 1 1 
for  details. 
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A  homogeneous  dyadic  tree  5,  as  illustrated  in  1-ig.  1, 
has  a  natural  notion  of  distance  c/l.v.  r)  het'Acen  any  two 
nodes,  s.  r  e  3.  By  choosing  a  particular  boundary  point, 
denoted  by  ~oo,  we  can  redraw  3  as  in  F-ig.  2.  Here  all 
of  the  points  that  are  at  the  same  “distance  from  -oo” 
appear  on  the  same  level  or  horocycle.  For  rnuitiscale  pro¬ 
cessing  we  can  think  of  each  horocycle  as  corresponding 
to  describing  signals  at  a  particular  scale,  with  liner  scales 
being  farther  from  -oo.  Also,  as  illustrated  in  the  tigure 
the  choice  of  -  oo  leads  naturally  to  a  backward  (line-to- 
coarse)  shift,  -y  ',  and  two  forward  (coarse-to-rtne)  shifts 
a  and  ji.  Also  it  is  useful  to  introduce  the  operator  5.  .As 
indicated  in  Fig,  2.  the  transfoniiation  6  which  inter¬ 
changes  nodes  /  and  f6  for  all  /  e  3,  can  he  thought  of 
locally  as  an  interchange  pivoted  at  the  immediate  ances¬ 
tor  ry  Higher  order  operators  6'"'  correspond  to  inter¬ 
changes  pivoted  at  more  distant  ancestors  oft  (i.e.,  ty 
n  >  1).  The  nodes  ?6'‘’  and  t6*’’  are  indicated  in  the  fig¬ 
ure. 

As  developed  in  (1],  all  nodes  in  3  can  be  coded  in 
terms  of  shifts  from  a  specified,  arbitrary  node  t„.  Specif¬ 
ically,  let 

£  =  (y  “')*  U  (y  '  )*  <5{a,  U  {a.  ii}*.  (2.1) 

Then  3  =  {r„ii  |vv'  e  £},  The  order  lic(  of  any  move  ic  e 
£  is  defined  as 

Ih'I  -  (/(/,  tic),  (2.2) 

A  move  w  is  causal,  denoted  by  w  0.  if  nt  is  on  the 
same  or  a  coarser  horocycle  than  that  on  which  r  is  lo¬ 
cated. 

A  zero-mean  stocha.stic  process  K,.  t  e  3,  inde.xed  by- 
nodes  on  the  tree  is  isotropic  if  the  correlation  between  T 
at  any  two  nodes  depends  only  on  the  distance  between 
those  nodes,  i.e., 

E\Y,Y.]  =  (2.,3) 

Equivalently,  Y,  is  isotropic  if  Z,  =  T,,,,  has  the  same  sta¬ 
tistics  as  Y,  for  any  isometry  /:  3  -*  3.  i.e..  any  one  to 
one  and  onto  map  of  3  onto  itself  that  preserves  distances. 
An  AR  model  of  order  p  has  the  form 

T,  =  «„ T,„  +  <jW,  (2.4) 

,1 

1.  £  I’ 

where  W,  is  unit  variance  white  noise.  Our  interest  here 
is  in  developing  AR  models  for  i.sotropic  processes,  and 
as  discussed  in  1 1 1,  the  con.straints  of  isotropy  imply  rather 
complex  constraints  on  the  «„  coefficients  in  (2.4).  Note 
also  that  the  number  of  these  coefficients  essentially  dou¬ 
bles  as  the  order  increases  by  1 . 

In  1 1 1  we  began  the  process  of  developing  an  alternate 
description  of  isotropic  AR  processes  in  terms  of  gener¬ 
alizations  of  the  Levinson  and  Schur  recursions  for  sta¬ 
tionary  time  series.  Because  of  the  structure  of  the  dyadic 
trees,  in  particular  the  fact  that  the  number  of  nodes  at  a 
given  distance  from  a  specified  node  increases  geometri¬ 
cally  with  distance,  the  development  of  these  recursion'; 
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and  the  lattice  filters  to  be  described  here  involve  predic¬ 
tion  error  vectors  of  dimensions  increasing  with  the  order 
of  prediction.  Specifically  ,  define  the  nth  order  past  of  ) 
at  node  / 

u-  <  0.  ju-l  <  n>  [1.5) 

where  ,1C{  •  •  •  }  denotes  the  linear  span  of  a  set  of  ran¬ 
dom  variables.  Then  the  nth  order  backward  prediction 
errors  at  node  t  are  given  by 

:T,  „  -  .lC{f,  „('i  ):  in-!  =  n.  n  <  0|  (2,(i) 

where 

/y  ,,("■)  -  h..  “  F(LJ‘V|,„  (2.7) 

We  alsi)  let  /,  „  denote  the  full  2’"  -'-dimensional  vector 
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of  F,  „(H’).  where  (.v)  =  largest  integer  <  x  and  where  the 
ordering  of  the  w  in  (2.6)  used  in  constructing  F,  „  is  de¬ 
scribed  in  [I).  Similarly,  we  have  the  nth  order  forward 
prediction  errors  at  node  t 

8,  „  =  X{E,  „{w):  Up!  <  n  and  n-  o  0}  (2.8) 

where 

F,  „(v>-)  =  -  F(>;j'y,.,  i).  (2.9) 

The  ordering  of  the  w  in  (2.8)  to  construct  the  2''"  “  " 
dimensional  vector  F,  „  is  described  in  11). 

In  j  1 1  we  began  the  analy  sis  of  the  recursive  computa¬ 
tion  of  these  prediction  errors  as  the  order  n  increases. 
What  we  found  was  that  as  in  the  usual  Levinson  recur¬ 
sions  for  time  series  the  forward  and  backward  prediction 
errors  of  one  order  could  be  expressed  recursively  in  terms 
of  projections  onto  prediction  error  vectors  of  the  preced¬ 
ing  order.  Most  importantly,  the  constraint  of  i.sotropy  al¬ 
lowed  us  to  show  that  the  required  projections  onto  mul¬ 
tidimensional  spaces  such  as  (F,  „  and  8,  „  reduced  in  fact 
to  projections  onto  specific  scalar  random  variables, 
namely,  the  barycenters  of  the  prediction  error  vectors: 

=  2-""-"'"  Z  £,„(w)  (2.10) 

|«i  <  n.ii  o  0 

/;.„  =  2-'""  Z  F,,„(VV).  (2.11) 

!»v!  ^  n.  w  <  0 

Indeed,  these  projections  can  be  expressed  recursively  in 
terms  of  a  single  scalar  sequence  of  reflection  coefficients 
k„.  Furthermore,  as  shown  in  (I  j,  there  exist  a  set  of  sca¬ 
lar  Levinson  recursions  for  the  barycenter  error  pro- 
ces.ses.  In  particular,  for/i  even 

^i.fi  Kft  - )  (2.12) 

f,.„  =  3  (/o  1  +  -  I )  -  (2.13) 


where 


k„  cor  iCf  /I  -  1  ■«  fi-'f  * , n  -  1 ) 

(2.14) 

and  cor  f.v,  y)  = 
1; 

=  F(.Tv)/[F(.r-)F(  V'))'  '.  For /I  odd,  n  > 

e,.n  ^  \ 

~  (  '’.ft  ~  1  )  -  I 

(2.L‘>) 

II 

C 

sc:; 

~  2  A'„  {€f  ^  1  +  I?  -’./i-  1  ) 

(2.16) 

with 

k„  -  cor  U 

■7.n  -  !  ^  1  )' //■> 

(2.17) 

Also,  for  n  = 

II 

II 

>i 

3 

O. 

-  y,.,  .  -  k,Y, 

(2.1«) 

II 

.r^ 

1 

(2.19) 

where 

,  ElYr.  .8,1  r, 

'  £18?,  ,|  r„- 

(2.20) 

In  addition,  the  variances  of  the  prediction  errors  satisfy 


the  following:  for  n  even 

(J,-,,  ^  F(c;„)  =  (1  -  ki)oi  i  (2.2!) 

oL  =  £(/;„)  =  ('- -  ki)oi  .2,22) 

For  n  odd 

o',  n  -■  o]„  -■  o:,  -  (1  ■  !  (2.2.f) 

where  (2.23)  holds  for /;  =*  i  as  well,  with  a;,  -  r,.  By 
using  the.se  equations  it  is  possible  to  dense  a  recursne 
procedure  for  computing  the  k,,  that  is  the  counier{iar!  of 
the  recursions  in  the  standard  Levinson  algorithm  lor  time 
series.  We  also  have  Schur  recursions  which  provide  an 
alternative  mechanism  for  computing  the  reflection  coet 
ficient  sequence.  .Specifically  .  define  the  fonna!  power  se 
ries 

P„  =  cov  (K.  c,  „)  =  Z  F(T,c,„,,)  ■  n  (2.24) 

Q„  cov  (T,./  ,,  =  Z  F(T,  /;,,  „i  •  I.  (2  2.^(1 

and  recall  the  following  operators  on  formal  power  series 
we  introduced  in  ]  1 1:  given 

5  =  Z  .V„  ■  IT 

„  f  e 

we  set 

15]  =■•  Z  .  •  le 
6'‘'|51  =  Z  ■  U-. 

11  f  c 


Then  for  n  even 


P„ 

Qn 

—  P„  -  \  k,,")  \  Q„  j  1 

=  3(7lC,-  il  +  -'\P„  il)  - 

k.,P,..  , 

(2.2fi) 

(2-27) 

where 

7l&,- ,1(0)  +  6'''  ■”(£„ 

.1(0) 

(2.28) 

2F„  ,(0) 


while  for  n  odd 

Pn  =  3  (£,. 

+  6""  "  "1P„-,1)  -  L.7lC7„ 

Qn  =  y\Qn 

,!  -  A„i(F„.,  4  6""  "  -'IF,, 

1. 

27l(?„  il(0) 

“  p 

"n  1 

(0)  +  6"''  "  -'1F„  ,](()) 

where 

Pi  -  Qi)  -  Z  r  „  •  IV, 

We  al.so  note  here  that,  as  for  time  series,  there  arc  eon 
straints  on  the  reflection  coctticicnts.  which,  thanks  to  the 
condiiioais  icquiicd  nil  a.n./iiv)py.  aic  slightly  more  com 
plex  for  isotropic  processes  on  dyadic  trees: 

for  n  even,  --  !  <  A,,  <  1 


(2..T3I 


I '!  is 
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for «  odd.  -  t  s  <  1.  (2.34) 

As  wc  develop  in  this  paper,  these  results  lead  to  lattiee 
struetures  for  AR  proeesses  on  dyadic  trees  in  which  only 
one  new  reflection  coetheient  is  introduced  as  the  order 
increases  by  one.  Furthermore,  the  constraints  (2.33). 
(2.34)  on  these  coetticients  are  quite  simple  and  are  de¬ 
coupled  from  one  another.  Thus  the  lattice  filter  parame- 
trization  of  AR  procc.s.ics  is  far  superior  to  the  direct  AR 
model  (2.4). 

III.  Vfctor  Lt  viNSDN  Rkcorsions  .\ni>  Moot  LI nc. 

AND  Whu  lninc;  Fh.i  lrs 

In  [1]  we  showed  that  the  recursive  computation  of  the 
components  of  the  prediction  error  vectors  „  and  F,  ,, 
involved  projections  onto  the  barycenter  error  processes. 
In  addition,  we  developed  scalar  Levinson  recursions  for 
the  barycenters.  In  this  section  we  combine  these  results 
in  order  to  develop  whitening  and  modeling  filters  for  Y,. 
As  we  will  see.  in  order  to  produce  true  whitening  filters, 
it  will  be  necessary  to  perform  a  further  normalization  o*' 
the  innovations.  However,  the  fonnulas  for  f ,  „  and  F,  „ 
are  simpler,  and  consequently  we  begin  w  ith  them. 

A.  Hirers  Involviiifr  the  Unnormalized  Residuals 

To  begin,  let  us  introduce  a  variation  on  notation  used 
to  describe  the  structure  of  the  covariance  matrix  of  the 
prediction  error  E,  „  which  we  denoted  in  1 1|  by  E/i  In 
particular,  we  let  1*  denote  a  unit  vector  all  of  whose 
components  are  the  same: 


We  also  define  the  matrix 

(3.2) 

which  has  a  single  nonzero  eigenvalue  of  1 .  Equations 
(3. 1),  (3.2)  define  a  family  of  vectors  and  matrices  of  dif¬ 
ferent  dimensions.  The  dimension  u.sed  in  any  of  the 
expressions  to  follow  is  that  required  for  the  expression 
to  make  sense.  We  also  note  the  following  identities; 

U^.U^  =  f/*  (3.3) 

f*  =  1  L’  F(u)  (3.4) 

vdim  F  " 

[f=l.J*  =  LUF  (3,.5) 

where  F  =  {f(«‘)}  is  a  vector  indexed  by  words  iv  ordered 
as  described  in  fij.  where /is  its  barycenter.  and  where 
f*  is  a  normalized  .vtsion  of  its  barycenter. 

The  results  of  1 1 .  Sec.  IV|  lead  directly  to  the  following 
recursion:-!  for  the  prcdic(i«<ii  error  vectors: 

Theorem  3. !  :  The  prediction  error  vectors  E,  „  and  F,  „ 
\alisf\  the  followinf’  recursions.  \  here  the  k„  are  the  re¬ 
flection  coefficients  for  the  process  Y,: 


For  n  even: 

E,  ,,  E  ,  ,  I  Mo 

^  ..  M  ^  , 

h.  ■  i  ■  k,  I  :  .  (  V  n 

‘  '  \F,  ,  i  '  \  (  T  : 

For  n  odd,  n  >  1 : 


F,.,  =  F,,  i  j  .3  4, 

while  for  n  ~  1  F,  |  and  E,  |  arc  si  (ihirs  \aiisj\  inv  (2  ISi . 
12. 19).  Here  the  retlection  coetTu  tent  sapience  k,,  is  cal¬ 
culated  from  the  correlation  function .  r,..  ,if  Y.  iiciordinv 
to  either  the  Levinson  or  Schiir  recursions  deserthed  in 
Section  II. 

Proof:  Equations  (2.18).  (2.19)  for  n  j  ex¬ 
actly  1 1 .  eqs.  (3.17),  (3, 19)1.  ,As  indicated  prex  iouslv .  ihc 
remainder  of  this  result  is  also  a  direct  consequence  of  the 
analysis  in  (1,  sec.  3  and  4|.  For  example,  from  (3  16i. 
(1.  lemma  4.1.  cq.  (4.6)1.  and  (3..‘x)  of  this  paper,  wc 
have  the  following  chain  of  equalities  for  n  exen: 

=  E,  ,j  ,  -  E(E, ,,  I '.F...  „  , ) 

=  F,,„  .. ,  -  XI/;,  ,  , 

=  E,„  I  -  MfF,..  ,  (3.10) 

where  X  is  a  constant  to  be  determined.  If  xve  prenuiltiply 
this  equality  by  (dim  F,  ,,  , )  1  '.  we  obtain  the  formula 
for  the  barycenter  of  E,  „  |.  and  from  (2.12)  we  see  (hat 
X  =  k„.  The  other  fonnulas  are  obtained  in  an  analogous 
fashion. 

The  form  of  these  xx  hitening  filters  deserx  es  some  com¬ 
ment.  Note  first  that  the  stages  of  the  filter  are  of  groxving 
dimension,  reflecting  the  growing  dimension  of  the  E,  , 
and  F,  „  as  n  increases.  Nevertheless,  each  stage  is  char¬ 
acterized  by  a  single  reflection  coefficient.  Thus,  xxhilc 
the  dimension  of  the  innovations  vector  of  order  n  is  on 
the  order  of  2"  ^  only  n  coefficients  arc  needed  to  specify 
the  whitening  filter  for  its  generation.  This,  of  course,  is 
a  direct  consequence  of  the  constraint  of  isotropy  arul  the 
richness  of  the  group  of  isometries  of  the  tree. 

In  1 1 1  xve  xtbtained  recursions  (2.21)  (2. 23>  for  the 
variances  of  the  barycenters  of  (he  prediction  vectors 
Theorem  3.1  above  provides  us  with  the  recursions  for 
the  covariances  and  correlations  for  the  entire  prediction 
error  vectors.  Wc  summarize  these  and  other  facts  about 
these  covariances  in  the  following. 

Caiidluis.  Lci  L,.  T,  ,,  denote  the  covanar"  e-  m  „ 
and  F, respectively.  Then 

1 )  For  n  even: 

a)  The  eigenvalue  of  L'/  ,,  assi'ciated  xvith  the  eigen 
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vector  1 1 ,  •  •  •  .  1 1  is 


2  o , 


cvih 


where  <t;  „  is  the  variance  of  c, 
b)  The  eigenvalue  of  Lf.  „  associated  with  the  eigen¬ 
vector  1 1 ,  •  •  •  .  1 1  is 


Mr..,  =  -  (’in 


where  aj,,  is  the  variance  of,/j 


2)  Torn  odd: 


V'  _  V  —  s' 
^f-.n 


(3.12) 


(3.13) 


and  the  eigenvalue  associated  with  the  eitzenvector  jl. 


M.,  =  M/  .„  ^  Mr.«  =  - 

where  u"  is  the  variance  of  both  e,  „  and  / 
3)  For  n  even: 


=  cov 


5:,,.,,  KU\ 

KU  ^vJ 


(3.14) 


(3.15) 


which  in  turn  follows  troiii  |1.  lemma  4  1  and  i4  27)| 
Finallv.  (3.  IX)  folUiws  from  (3  15)  and  (3.X).  and  (3  14} 
is  immediate  from  (2.  IH)  (2.20) 

Just  as  with  time  senes,  the  whitening  tiitcr  spcvilica 
tion  leads  directlv  to  a  modeling  lllter  lor  ). 

Tht'drcm  J.2:  Tin-  ttuiji'liiii;  lilwi  far  )  i\  c,'w/i  h\  ilu 
folliiuini;.  f  'lir  n  i  vcii 


u/icrc' 


/  0  k..L'. 

S{k..)  =-  .  (.V24> 

-LU^  I  (A,^  -A:i{', 

_  0  (/  -A:.F,  i_ 


For  n  oild.  /i  >  1 : 


/  A..(;  1 

.S(A„)  =  . .  I  i3.2b) 

d  -  kiv^)\ 


Proof:  Equations  (3.11),  (3.12).  and  (3.14)  follow 
directly  from  the  definition  of  the  barycenter.  For  exam¬ 
ple,  for  ti  even 

2'"  -’  -'e,,.,  =  (3-20) 


while  for  n  =  \  : 


from  which  (3. 1 1 )  follows  immediately.  Equations  (3. 13) 
is  a  consequence  of  1 1 ,  lemma  4. 1 1.  To  verify  (3. 15)  let 
us  first  evaluate  (3.6)  at  both  /  and  /S'" 


(3.21) 

The  first  equality  in  (3.15)  is  then  a  direct  consequence 
of  1 1 .  lemma  4, 1  ]  (compare  (3.7)  and  (3.21 )).  The  form 
given  in  the  rightmost  expression  in  (3.15)  is  also  im¬ 
mediate:  the  equality  of  the  diagonal  blocks  is  due  to 
isotropy  ,  while  the  form  of  the  off-diagonal  blocks  again 
follows  from  [  1 ,  lemma  4. 1 1.  The  specific  expression  for 
E,  „  in  (3.16)  follows  directly  from  the  second  equality 
in  (3.10).  while  (3.17)  follows  from  (3.21)  and  the  fact 
that 

F\F,  „  I  (ti) |(u  ')l  A„of,  ,  (3.22) 


(3.27) 

These  equations  can  be  verified  by  solv  ing  (3.6)  -(3.4)  and 
(2. 1 8)-(2.20)  to  obtain  expressions  for  F\  of  order 
n  -  1  and  F's  of  order  n  in  terms  of  F's  of  order  n  and 
F’s  of  order  n  -  1.  Note  should  also  he  made  <4  the  di¬ 
mensions  of  the  various  signals  and  matrices  in  Thec'rem 
3.2.  In  particular,  for  n  even  the  (wo  components  on  the 
left-hand  side  of  (3,23)  are  of  dimensions  2  "  '  and 

2'"  respectively,  while  all  three  td  the  vectors  on  the 
right-hand  side  of  (3.23)  are  of  dimension  2  "  '  '  and 

each  of  the  square  blocks  in  (3  24)  is  2  '  '-dimen¬ 
sional.  For  n  odd,  n  >  1.  both  components  ot  the  right- 
hand  side  of  (3.25)  are  2'"  ' '  -dimensional  as  is  the  F  ,,- 
block  on  the  left-hand  side.  The  two  F-bh'cks  on  the  Ictf- 
hand  side,  however,  arc  2''  *'  -dimensional,  and  the 

'In  wo  shtuild  pnfpcrlv  kknii’  .V(4  .  n)  sinvc  Ifu'  »!)mcnM«’n  .'{  ihc 
blocks  4k’pcnAis  >1 .  DCS chIjcIcss .  uc  clin‘>sc  i(‘  ssnu-  Vf4.  )  Mmphls 
fhc  noialion.  ihjs  \sill  he  tli^nc  cscnuhcrc  in  thv'  s(,*ipicl 


il  M  i  K  V  i  U  AS  «  A  si?  ,N  M  l’K<  »i  J  Sn!  \? 


tour  square  blocks  in  (3.2bi  aiv  2  '  '  -Jimcnsir)tuil.  VS  e 

have  included  doiteil  lines  in  (.v2.?)  (>,26)  cinphasi/e 
iiow  ihe.>e  inappines  operate .  Note  also  that  the  lirst  sec¬ 
tion  (3.27)  o!'  the  nn'delin”  lilter  iiuolves  onK  scalar 
tjuantities. 

As  is  the  case  It'r  time  senes,  the  lattice  modelinj!  lilter 
ot  Theorem  3.2  has  a  scailerine  layer  structure.  An  im¬ 
portant  ditference  here  is  that  the  gtxn^ing  dintensmn  ot 
the  prediction  errors  leads  to  a  tree-like  structure  tor  the 
scattering  diagram,  and  because  ot  this.  \ce  lind  that 
groups  ot  values  of  Y  are  calculated  together  in  this  struc¬ 
ture.  In  particular,  from  Theorem  3.2  v\e  can  deduce  that 
if  we  consider  a  modeling  tilter  of  odd  length  .V.  then  this 
modeling  tilter  ean  be  viewed  as  a  map  ftom  the  2'^  " 
dimensional  input  vector  T,  ^  to  the  2'"'  ''  -dimensional 
set  ot  outputs  "■  *  ()}.  For  .V  even,  the 

modeling  Hiter  maps  the  two  2  '  ’  '-dimensional  input 

vectors  E,  \  ^  to  the  2'''  '’-dimensional  set  of  out¬ 

puts  {>i„  ioi  !  <  A',  ic  o  ()}.  The  case  of  A'  -  6  is  illus¬ 
trated  in  Fig.  3.  In  this  case  the  input  sectors  E,  „  and 
E„  „.  produce  the  outputs  Y,„  for  u-  c  0.  Uc|  <  6  {a.-^ 
well  as  the  backward  errors  E,  „  and  E,.,  ■  h.  w  hich  are  not 
actually  needed  for  the  recursion).  The  E'  sectors  of  var¬ 
ious  orders  propagate  from  left  to  right,  while  the  E‘s 
propagate  from  right  to  left.  The  small  black  squares  rep¬ 
resent  ■>  '  operations  and  the  blocks  labeled  “1."  ■‘2.‘‘ 
etc.,  perfonn  the  computations  described  in  Theorem  3.2. 
The  details  of  the  operation  of  this  system,  hosscser.  re¬ 
quires  further  explanation. 

Let  us  first  took  at  the  situation  (dr  n  odd.  in  which  ca.se 
each  block  labeled  "n"  performs  the  calculations  given 
by  (3.25)  (or  (3.27)  for  n  ~  I).  For  example,  the  inputs 
to  the  top  •■3"  block  in  the  figure  (which  has  been  .shaded) 
are  E,  ;  and  E,.  i.  svhile  the  outputs  are  E,  E.„  -.  and 
E,  ).  Note  that  this  block  is  connected  to  the  right  to  >ys- 
tems  generating  both  Y,  and  T,„.  but  apparently  we  do  not 
need  a  corresponding  ■■3"  block  at  i6  in  addition  to  the 
one  at  t.  To  understand  this,  consider  writing  (3.25)  at 
tb"”'  ' '  rather  than  at  r; 


E,, . 

n  1 

-E„v,.. 


(3.2K) 


where  we  have  used  the  fact  that  for  any  A.  (3'*'  is  its  own 
inverse.  Note  that  the  lirst  two  components  of  the  output 
in  (3.2H)  are  simply  a  pennutation  of  the  lirst  two  in 
(3.25).  I'hc  last  outputs  in  these  equations  and  both  inputs 
apparently  differ.  However,  it  is  easily  checked  that  (he 
outputs  E,  „  and  E',,v  ■  «/  Ofc'  identical  up  to  a  permuta¬ 

tion  of  the  ordering  of  components,  as  are  the  input  pair 
E’,  „  and  E,v  ■  „  and  the  input  pair  „  ,  and 

E',,,  -  I  „  i  (this  latter  fact  is  proved  in  the  '"umbili¬ 

cal  lemma"  of  .Appendix  A  and  expressed  via  the  "um¬ 
bilical  cords"  -doited  connections- of  Fig.  3).  Thus  there 
IS  actually  no  need  to  have  a  "3"  block  ;it  rb  as  there  was 


at  /.  or  more  generally  .m  "n"  block  at  lb  '  as  well 


a-'  at  /. 

For  II  esen.  the  block-  labeled  "n"  pertorm  the  c.i! 
culations  as  specitied  by  (  3  2.')  For  example,  the  mpuis 
to  the  top  "2"  box  m  (he  ligurc  are  E  .  1.  .  and 
b]  |.  XX bile  the  outputs  ate  E  j  and  E  Again  it  is  im 
portant  to  examine  the  analogous  com|ni’aiioii  at  a  ici.ited 
point.  .Specilically .  consider  c\ aluatut!.’  ( .'  23 )  .it  ilie  point 
rb'"' 


.S'(A,  ) 


E 

E. 

E 


i 

1 

I 

I 


I 
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Note  hrst  that  the  (iist  oinpui'.  ot  i3  23i  and  (3  2di. 
namely  .  E.,,„  ,  and  E..  „  ,  are  in  fact  disimct.  .md  thus 

it  is  necessary  to  implement  the  conipu'ation  (3  2'li,  For 
example,  the  second  "2"  block  (also  shaded)  m  Fig  3 
computes  as  one  of  its  outputs  E  ,  Next  note  that  the 
other  outputs.  E'.  „  and  E.  ,.  ot  i3,23)  and  (3,2Mi  arc 
ntrt  identical.  Hoxxexer.  these  signals  must  pass  through 
a  '  operation  bettue  entering  the  corresponding  "ii  • 

1 "  block,  and  we  have  already  seen  m  our  analysis  of  the 
odd  case  that  E.  .  and  E’.  .  are  identical  up  to  a 

permutation.  Thus  only  one  of  these  is  needed  tor  a  block 
at  level  ii  *  1.  This  is  indicaicil  in  the  Itgure  by  a  con¬ 
necting.  dt'tted  bar  between  the  block  immediately  to 
the  left  of  pairs  of  even  numbered  blocks,  with  only  one 
of  these  identical  signals  continuing  backxxard  to  the  cor¬ 
responding  i-r  *  1  block.  For  example,  the  two  left  going 
xrutput  signals  of  the  shaded  "2"  blocks.  E  •  and  E'.  -. 
are  merged  in  this  way  after  the  y  '  operation  on  each, 

Examining  next  the  right-hand  sides  of  i3.23)  and 
(3.2*^)  we  see  that  the  lirst  two  inputs  are  identical  except 
for  a  Hip  in  the  order.  This  is  captured  m  the  ligurc.  as 
can  be  seen  forn  =■  2.  where  the  txxo  inputs  entering  Irom 
the  left  of  the  second  "2"  block  are  the  same  as  those  tor 
the  lirst  "2"  block,  except  m  reverse  position.  It  is  also 
not  dillicult  to  check  that  the  last  inputs  E..  ,  and 

E,,v-  -  1  „  I  are  identical  up  to  a  permutation  of  compo¬ 

nents.  While  these  signals  do  enter  itnlixidtial  blocks  ae 
have  again  indicated  that  they  are  the  same  b\  a  connect¬ 
ing  dotted  bar  between  the  y  '  blocks  immediately  to  the 
right  of  pairs  of  even  numbered  blocks.  For  the  case  of  n 
=  2.  the  two  left-going  input  signals  of  the  shaded  "2" 
blocks.  E,.  I  and  E,..,  ■  |  are  identical  and  arc  connectcxl 
by  such  a  dotted  bar. 

F'igs.  4  and  5  describe  in  more  explicit  terms  (he  data 
How  and  memory  structure  lor  the  system  of  (irdci  6.  Spe 
cilically  suppose  that  xxc  have  linished  the  computations 
required  at  the  horocycle  imlicated  with  squares  in  Fig 
4,  As  indicated  in  (he  tree  at  the  top  ot  this  figure  (\  la  a 
shaxled  b  ir  connecting  the  squares),  sets  ot  I  nodes  at  tins 
level  are  coupled  together  (more  generally  for  .in  uth  or 
der  model  2 ''  '  points  are  coupled  ti'gclhcr)  The  state 
lor  this  set  ot  four  nodes  is  indicated  above  (lie  nodes  we 
ha  e  stored  the  scalar  x allies  ot  }.  E',.  and  E.  al  each  node, 
we  haxc"  stored  the  2  vectors  Ei  and  E;  tor  each  ot  iwo 
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F-'ig.  y  lllu.strating  the  NCaUcring  latliec  stnicniro  ol  the  miKlcUtig  liUcr  iU  Theorem  VZ  lot  a  vixtli  orUer  mmlel  !  M.\l, 

labeled  "It"  portiirms  the  corr.nulatiDn  in  (tor  n  ercni.  13-51  ilor  n  oiUl.  it  >  1 1.  or  1 3  -“)  i  lot  n  It  1  tie  Mii.ili 

>quares  denote  •)  '  I'peraliont.,  and  the  dotted  eonneetione  between  Mich  square',  (llie  ninbilieal  eoidst  indieate  signals  lat  ttie 

outputs  of  these  squaresi.  that  are  identical  up  to  a  perinntaiion  ol  eotnponenis  As  mdicaied  at  'tie  top  ol  tlie  ligure,  the  signal' 
Mowing  through  this  system  are  the  .‘t  and  /■'  error  processes  of  successive  orders,  wiih  the  /■  s  Mow  me  Id  I  to  nehl  arid  itic  /  A 
right  lt>  left. 


Fs 


Tig.  4  Illustrating  the  propagation  of  state  inlorniation  lor  the  tiller  m 
Tig-  4  The  stored  inlormalion  (indicated  above  the  lop  portion  of  the  tig 
tire  I  tor  a  set  ot  lour  nodes  at  the  horoeycle  indicated  hv  svttiares  is  uscil. 
together  with  (he  input  vectors,  to  eonipiite  the  tveo  eorresponiling  sets 
of  inforimition  at  the  two  descendem  groups  ol  lour  points  at  the  next  hom 
cycle 


pairs  of  these  ntrdes.  and  we  have  stored  a  single  4-veetor 
F<i  for  the  set  of  4  nodes.  Given  these  quantities  and  the 
two  4-vector  £>,  inputs  for  each  of  the  two  sets  of  4  de- 
scendent  nodes  (indicated  with  circles,  with  a  connecting 
bar  for  each  set),  the  mode!  performs  two  parallel  com¬ 
putations  (which  arc  identical  in  structure)  tt)  produce  the 
required  variables  to  be  stored  at  each  of  the  two  sets  of 
descendant  nodes.  Fig.  .“x  illustrates  in  more  deta'I  Inrw 
these  compulations  arc  distributed  and  performed.  Here 
at  each  level  the  variables  required  as  inputs  are  indicated 
with  while  those  produced  as  tmtputs  arc  indicated 
with  ‘‘I."  Furthermore  those  inputs  corresponding  to  the 
stored  state  are  indicated  above  each  layer  tif  the  com¬ 
putation.  while  below  each  ligure  we  indicate  the  inputs 
received  externally  (?£,. )  or  from  previous  layers  (all  other 
?/:’s).  We  also  indicate  below  each  laser  the  outputs  pro 
duccd.  some  of  which  (the  !/ 's  at  layers  2  b  and  the  ')  "s 
at  level  1)  form  components  of  the  state  at  the  next  hv'ro 
cycle  while  others  of  which  (the  ’/fs)  are  used  as  inputs 
by  succeeding  layers.  For  example,  at  the  top  level  /  v  is 
.stored  and  two  £„  vectors  arc  received  as  the  only  external 
inputs,  This  layer,  as  shown  in  Fig.  lias  two  actual  sets 
of  outputs.  One  of  these,  the  £,,  vectv'ts.  is  not  needed  fm 
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Fig.  5,  Illu.Mraling  the  lielJilcd  eonipuiationa)  flow,  lor  ihc  propagaiion  o 

•  rt.i  j 


stale  intonnalion  tor  the  tiller  described  m  Figs 


the  subsequent  computation  and  indeed  is  typically  not 
computed  in  lattice  implementations.  The  other  outputs 
produced  are  the  vectors  which  will  not  be  stored  as 
part  of  the  state  at  the  next  horocyclc  but  which  do  show 
up  as  inputs  to  the  layer  3  blocks. 

We  have  also  included  node  indices  in  part  of  Fig.  5  to 
make  it  easier  to  connect  the  computational  structure  of 
the  figure  with  the  computations  described  in  (3.23)- 
(3.27).  For  example,  the  lower  left-hand  ponion  of  layer 
1  (distinguished  by  shaded  circles  and  f  ires)  corre¬ 
sponds  to  the  pair  o(  cnniputailons  corresponding  to  (3,27) 
evaluated  at  /  and  at  r6.  Also,  at  higher  layers,  we  en¬ 
counter  vector  error  processes,  and  as  we  have  seen,  these 
vectors  are  not  distinct  or.  in  fact,  needed  at  all  nodes. 
For  c.xample.  consider  the  portion  of  the  layer  3  compu¬ 
tations  indicated  by  shaded  squares.  This  describes  the 
computation  of  (3.23)  for -  5.  which  requires  a  single 
f.s  input  at  node  l.  a  single  stored  vector  at  ty  '  and 
produces  one  f ^  vector  at  node  i  and  two  vectors  at  / 
and  lb''' ■  In  this  case,  as  we  have  pointed  out.  a  single  Fj 
vector  needs  to  be  stored  for  the  pair  of  square  nodes  con¬ 
nected  by  the  solid  bar  in  the  figure.  Wc  have  indicated 


its  index  ty  '  in  the  center  of  the  bar.  Similarly,  the  index 
I  of  the  single  F^  and  Fs  vectors  is  indicated  in  the  center 
of  the  lower  .solid  bar,  while  the  indices,  i  and  ib'''.  for 
the  two  Ei  vectors  are  indicated  above  the  appropriate 
portion  of  the  solid  bar.  Note  that  the  apparent  redundan¬ 
cies,  indicated  by  the  shaded  bars  in  Fig.  4.  arc  not  pres¬ 
ent  in  Fig.  3.  as  in  this  figure  we  have  shown  just  those 
variables  required  to  be  stored  and  computed  from  horo- 
cycle  to  horocyclc. 

As  we  w  ill  see.  understanding  the  structure  of  the  filter 
described  in  Figs.  3-3  greatly  facilitates  our  anaivsis  of 
stability. 

B.  Levinsdu  Rei  ursioiis  for  the  Noniializcil  Rcsidiuils 

The  prediction  errors  F,  „  and  F,  „  do  not  quite  detinc 
isotropic  processes.  In  particular,  the  components  of  these 
vectors  representing  prediction  error  vectors  at  a  set  of 
nodes  are  correlated.  Furthermore,  for  n  even  we  have 
seen  that  F,  „  and  F,,s...  .  „  ,  are  correlated  (see  l3  15)) 
These  observations  provide  the  motivation  (or  (lie  nor¬ 
malized  recursions  developed  in  this  section.  In  this  de- 
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velopment  we  use  the  superscript  *  to  denote  norniali/ed 
versions  of  random  vectors.  Specifically,  X*  =  L’,  '  'X 
w'here  E,  is  the  covariance  ofX  and  E|  'is  its  symmetric, 
positive  definite  square  root. 

We  now  can  state  and  prove  the  folh>wing. 

Theorem  3.3:  For  11  odd  the  eovariaiiee  mairi.x  E,.  de- 
Jined  in  (3. 13)  is  invertible  if  and  only  if  ~  \  <  k„  <  i . 
For  n  even.  E,,  as  defined  in  (3.  IS),  is  invertible  tf  and 
only  if  -  1  /2  <  k„  <  1 .  Under  these  conditions  the  whit¬ 
ening  recursions  of  Theorem  3. 1  can  he  normalized, 
yielding  the  following  recursions  for  the  normalized  re¬ 
siduals: 

For n  even: 


F  ■ 

-‘./j 


=  F)(k„) 


F*  . 
e-i,-,":  I 


k  '  I  F*  1 
\  * ./ 


(3..U)) 


f*r  =  e(A„) 


F-,.  A 


^  1)  '.n 


(3.M) 


where  0  '  (k„ )  is  the  matri.x  square  root  satisfying' 

0  '{kfi  =  ,  ,  ),  (3. .32) 

\{k„  —  k'„)^  I  —  k‘;,U^  j 


For  n  odd.  n  > 


E,,n  =  0(^,,)  I  '  1  -  k„U^F,\  i,„  I 


(3,33) 


F*„  =  Q(kfi  F*  I  „  .  I  -  k„U\ 


F-,,n  -  I 


■'fA""  ’’  *'.«  1 


(3.-34) 


0  '{k„ )  =  /  —  A  "  Uj,,. 


(3.33) 


with  the  fad  that  for  n  even  dim  f  „  -  2  dim  /.  . .  wlnlc 
for /(  odd  dim  F.  ,,  --  dim  F.  „ 

Pro<>l:  Let  us  first  derive  1 3.3(f)  (3  37)  aN'umine  the 
invertibilily  of  E„  for  eaeh  n.  Ihis  resull  is  .i  relatively 
straightforward  computation  given  (3  lit  Idi  [<ti  u 
even  we  begin  with  t3.7)  and  (3,2h  and  pieniultiply  eat. Is 
by 

diag  (E,  '  ,  .  E,  '  ;  ) 

Since  1,;.  is  an  eigcnveeti'r  of  E,  E.  ^  and  ihereioiL 
E,,.  '  comnuue  with  T*.  This  immediateiv  yields  (3  do 
and  (3.31 1  where  the  matriv  OU  »  o  simply  ihe  inverse 
of  the  square  root  of  the  cov  ariance  of  the  term  m  hraekcis 
in  (3.3()i  and  in  (3.311  (the  cqualitv  of  these  sov.iri.iiKes 
follows  from  (3  15)1.  liquation  (3  32i  then  follows  from 
(3.11)  and  (3. 15),  The  case  of  n  odd  involves  .01  aiiaio 
gous  set  of  steps,  and  the  n  -  1  case  is  immediate 

The  preceding  analysis  provides  us  hmh  with  the  eon 
ditions  for  the  invembility  of  E,  and  with  a  recursive  jiro 
eedurc  lor  calculating  E,  ’  (sec  |  I.  .ippeiuiiv  1)|  fiu  .m 
alternate  efficient  procedure),  hot  n  even  we  have 


E„  '  ■  -  ()(A,,)  diag  lE,  '  E„  '  , 

)  1  3  ,'5 1 

while  for  n  odd.  n  >  1 

E„  ‘  -  ()(A.tE,  '  f 

1  3 ,  .'V)  1 

and  for  n  -■  1 

i:, '  '  -  1<1  •  a;);-„i  '  ^ 

(3.401 

Note  first  that  from  (3,40)  we  see  that  Ay  must  he  less 
than  1  for  E|  '  to  exist.  I'or  a  >  I  ai  d  otid.  note  that 
the  only  nonunity  eigenvalue  of  /  -  k;  I  f  is  1  -  A;,  and 
thus  0(A„ )  exists  for  n  odd  if  and  only  if  A,  <1  .Also 
in  this  case  we  can  readily  compute  0)A,  1  using  the  fol¬ 
lowing  fomiula.  F-ivr  any  A  >  -I 


(/  +  A//,)  "-  =  /+(  =  1  ]  (7..  (3,41) 

\ el  A  A  ^ 


For  n  even,  we  make  use  of  the  result  that  for  .S  and  / 
symmetric 


For  n  =  \  : 

F*,  =  -  k,y*  :)  (3.-36) 

/r*  ^  ,3,37, 

VI  rC  I 

Remark:  Note  that  for  n  even  we  normalize  F,  „  and 
”  e  „  together  as  one  vector,  while  for  n  odd.  F,  „  is 
normalized  individually.  This  is  consistenf  with  the  na¬ 
ture  of  their  statistics  as  described  in  (3. 13)  (3. 19)  and 

Again,  lo  be  precise,  wc  should  write  rn  rather  than  I.  H>r 

simplicity  we  use  the  less  cumbersome  notution 


where 

X  -  (.V  ^  /■)  '  - 

Y  =  (.S'  -  T)  '  ’.  (3.43) 

Using  (3.42).  (3,43)  we  see  from  (3,32)  that  to  calculate 
0(A„)  for/;  even  we  must  calculate 

(/  +  (A,.  -  2ki)lf.)  '  ' 

and 

(/  -  A„(/,j  '  ■ 

which  exist  if  and  only  if  1  2  <  A„  <  I.  comiileting 
our  proof 


1^4 


mi 


{  H  \\s\(  t  i(  f\S  U\  sfl  l'H>  X  }  SSj\l .  Mil 


M  <  :I  si 


It'  L,  -  12  or  1  tor  n  even  or  k,:  <  1  tor  n  oiid, 

the  resulting  error  processes  are  not  full  rank  I'his  ts  the 
simplest  example  ot  a  singular  process,  tor  which  pertect 
prediction  of  a  linear  comhination  of  )''s  on  a  given  horo 
cycle  can  be  obtained  using  only  a  tinile  set  of  values  of 
y'on  “past”  horoeycics.  Ip  .Section  IV  vve  will  charticter 
i/e  the  full  class  of  singular  prticesses  in  terms  of  its  in- 
tinite  reflection  coetlicient  sequence. 

Now  that  vve  have  a  norma!i/ed  form  tor  the  residual 
vectors,  vve  can  also  describe  the  nortnali/ed  version  of 
the  modeling  filters  which  provide  the  basis  for  generating 
isotropic  f.'s  speeilied  by  a  finite  number  of  reflection 
coetfictents  and  driven  by  white  noise. 

Theorem  J.4:  A  normali:e(l  modeliim  filter  for  the  i\o- 
tropie  [iroeess  Y,  e  xi  sts  if  and  onl\  if  -  ]  <  A,,  <  \  for  n 
odd  and  -  I  2  <  k.,  <  1  for  n  evn.  In  this  ease,  this 
filter  has  the  following  form.  F<>r  n  even  u  c  have 


F* 

r  if 

F*. 


riA- 


n. 


(.V44t 


where'' 


For  n  (Hid.  n  *  1 

.. 

K,. 

where  the  seatlertni; 

rtA.) 


UfA,  I 


salislies 


For  n 


and 


i:(A.,) 


/  +  a{k„)LU 

_  V  '  * 


cHk..)U 


Ink.. )  L', 


(/ 

-  A„  U. 


main  t 
A:4'  i' 


A I 


i;(A,,)i;'(A,,)  -  /. 


Y* 


Uk.)  - 


Ak, ) 


\ 


/f', 

)'2 


A-, 


A I 

\  (  A 


/  f  elk,,)  If  Ink.,)  if, 
A., 


( '  1 1 


(.V52i 


I .'  54 1 


I I 


I.V4.V) 


if 


I  r  a{k..)i.  ,„ 


with 


s'\  -v  2k  +  1  - 

</(A)  =  - . -  . .  V  I  -  A 


vl  -f  2k  -  1  ,  - . - 

hik)  =  - .  - . .  Vi  k 


e{k) 


Vl  +  2A  -  (I  +  A) 
1 


Zik„)  =: 


O  '(A„) 


0(A..) 


(.5.46) 


(-5.47) 


(.5.4S) 


k„if.  I 
-k.,lf  0 


als<i  .sati.slies 


UlA,  )i:''A,  I  r  /.  (.5. .56) 


Proof:  W'e  bi.gin  bv  solving  i.5..5(')  tor 
iF*!,  I  F*'.  „  I  )Shen  by  substituting  this  into  ( .5  .5 1 ) 

vve  obtain 


(.5  .'',  ) 


where 


O  '(A,)  ()iA„) 


(A„  A:,)f'* 

/  A-fV 


/  /•'  *  \  'V  "1 

(F,,  y 

-  Elk.,) 

U'c, 

I'l. 

n.  .  .  , 

(.5.5,5) 


dik)  ==  -<(A)  .  A.  (.5  4M) 

The  matrix  E(k„ )  is  referred  to  as  the  searterini;  matrix, 
and  it  satisfies 

Lik.AEfk,,)  -  /.  (.5,. 50) 


Aiiain  wc  shoiicn  fhc  nolulmn  anti  wnic  f.ithA'r  thiin  i.K,  .  n) 


To  obtain  the  desired  relation,  we  simply  drop  the  cal¬ 
culation  of  F*..  ■„  I  from  (5. .57)  I'o  ilo  this  explicitly 
wo  consider  Elk,,)  as  a  matrix  will)  three  block  columns 
and  four  block  rows  (one  each  for  F*,,  ,  anil  tff-  „  , 
and  two  fur  /•',*„).  rhus  what  vve  wish  to  do  is  to  drop  the 
second  block  row.  A  careful  calculation  using  the  rcia 
(ions  derived  previously  yields  (.5  4.5)  i.5,4V).  That  Elk.. ) 
satislies  (.5. .50)  follows  immediately  from  the  tact  that  the 
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vectors  on  both  sides  of  (3.44)  have  identity  eovarianecs. 

1  'le  result  for  ii  odd.  /i  >  1  is  obtained  in  a  similar  fash- 
H.n.  and  the  ease  of  n  =  I  is  immediate. 

IV.  RiIIKIION  ColllKIlMS  \\l>  IHI  PkOI'l  k  111  S  1  It 
Pkoci  ssi  s  AM)  .Mom  i.s 

I'he  analssis  in  |1|  and  in  the  precediiie  sections  pro- 
sides  us  with  a  framesAork  in  which  sve  can  sa\  a  ereat 
deal  about  stochastic  priicesses  and  d\naniic  s\ stems  on 
trees  In  the  first  subseciioi’  we  provide  a  complete  char- 
acteri'ation  ot  isotropic  autorceressis e  processes,  and  in 
.Subsection  1V-F3  we  characteri/e  purels  nondeterministic 
processes.  In  Section  IV-C  we  relate  the  stabilits  of  the 
lattice  models  on  trees  to  the  retlectiim  coetlicienis.  while 
III  Section  IV-D  we  show  that  all  lattice  filters  with  ap- 
iiropriately-ci’nstrained  reflection  cocllicienis  sield  .AR 
processes,  showitiu  the  one-to-one  correspondence  be¬ 
tween  these  filters  and  processes  In  each  case  there  are 
similarities  to  the  analysis  for  stationarx  time  series. 
However,  the  more  complex  staiciurc  of  the  dxadic  tree 
leads  to  some  imponant  and  substantive  differences. 

A.  Cluirdi  tcriTdii'in  (>f  Aiit()r(‘i;ri’s.siw  Pnu  csscs 

A  well-known  and  essentialK  trivial  result  for  time  se¬ 
ries  is  that  if  Y:  is  a  /Mh  (irder  autoregressive  process,  then 
the  reflection  coctiicients  k„  are  0  for  n  >  p  ^  \ .  Fur¬ 
thermore.  ihc  /nh-order  forward  and  backward  prediction 
errors,  which  are  also  identical  to  the  nth  order  prediction 
errors  for  ii  >  />  *  1 .  form  white  noise  sequences.  The 
following  result,  which  states  the  counterpart  of  this  re¬ 
sult  fio  isotropic  processes  on  trees,  icquires  some  pref¬ 
atory  comment.  Specifically,  thanks  to  the  vector  nature 
of  our  models,  i.e,.  the  fact  that  a  group  of  K's  on  a  given 
horocycle  are  generated  together  from  a  group  of  the  F's. 
the  prediction  error  processes  whose  whiteness  we  con¬ 
sider  consist  of  sampled  versions  of  the  (normali/.ed)  £ 
and  /'processes,  with  one  ■’sample"  taken  per  "group." 
In  particular,  from  our  discussion  at  the  end  of  Section 
III-A  and  fr  m  the  definition  (2.8).  (2,9)  of  £, ,,.  we  find 
that  the  components  of  £,  „  and  £,„  „  are  permutations  of 
tine  another  if  iv  o  0  and  nej  <  /;  -  I.  Thus  we  need 
only  consider  one  of  these  vectors  for  each  group  on  each 
horocycle.  Note  that  this  means  that  we  are  choosing  tnily 
one  out  of  2'"'  error  vectors,  but  each  vector  is  ex¬ 
actly  of  dime.ision  2''"  ''  .so  that  we  do  have  the  cor¬ 
rect  number  of  total  degrees  of  freedom,  one  per  node  on 
the  tree. 

Turning  to  the  backward  residuals,  we  find  from  the 
discussion  in  Section  Ili-A  and  the  definition  (2.6).  (2.7) 
of  £,  „  that  the  components  of  £,  „  and  £,.,  ,,  for  w  c  0 
and  lU'j  <:  n  -  I  are  permutations  of  one  another.  On  the 
other  hand,  as  pointed  out  (for  u-  -  in  Section 

IH-A.  if  n  is  even,  so  that  it  is  possible  to  find  w  o  0 
with  Iwi  ■  n.  £  „  and  do  not  have  identical  rets  tif 
components.  Furthermore,  it  is  easily  checked  that  these 
vectors  are  not  uncorrclated.  However,  as  is  also  pointed 
out  in  Section  ill-A.  the  signals  i  „  and  i  „  do  have 


identical  component  sets,  and  it  is  only  these  "delayed' 
signals  that  play  a  role  in  the  modeling  filter  Thus  for  our 
purjioses  hen  we  need  choose  only  one  \ccMr  from  the 
set  >v  o  0,  .<  /i[ .  In  this  case  wc  arc  choiising 

one  2'"  '-dimensional  vector  from  a  set  of  2'  '  sucii 

Vectors,  again  producing  the  correct  number  ol  degrees  of 
freedom . 

Finally,  as  wo  have  noted  in  Section  III  H,  it  is  ncscs 
sary  to  normali/e  the  prediction  error  processes  1  or  liie 
backward  prciliction  errors,  this  simpK  means  that  wc  will 
consider  the  FT,,  rather  than  the  F  , .  Similaiiv  for  n  ovkl 
we  consider  the  FT,,.  However  for  u  even  our  normali/a 
tion  involves  the  combined  normali/aiion  of  /.  ,  aikl 
£.,-,.■  ■  .,  (e  g.,  referring  to  F  ig.  3.  the  two  inputs  /.  .  and 
£,,,  ,,  are  normali/ed  togcthei '.  riuis  lor  u  even,  instc.id 

vif  choosing  one  \  ector  from  [ /•.  u  c  0.  n  r;  /; 
l>  u'  o  0.  i"  •£  n  ■  IJ  we  choose  one  vectoi 

(of  twice  the  dimension)  from 


n  C  0.  u  <  u 


Proposition  4.1:  If  Y,  is  on  .ARi  pt  is<>tropi<.  proi  css. 
then  the  rejiei  ti<in  eoejfu  ienis  k.,  ore  0  for  n  p  -  1 
Furthermore .  the  forward  tind  hiiekward  no)  nialited  jue- 
dieiion  error  vectors  of  order  p  and  greater  form  staiuhird 
white  tunse  pirn  esses  li.e.  .  with  units  eovtirianci  i.  .More 
precisely,  let  t,,he  an  arhitrars  node  on  the  tree,  and  (  (in¬ 
sider  an  infinite  se<iiienee  of  /iredeeessors  and  si:  .-(  essors 
to  he 

T  -  \t.r,  Fk  >  0}  U  {i.at'F  a  I}. 

Then  for  anv  n  >  p.  the  set  of  backward  predi(  tion  error 
veefors 


forms  a  standard  white  noise  process  Similarh  .  for  n  > 
p  and  odd.  the  set 

(  n  ) 

w^el.t>^, 

forms  a  standard  while  lutise  /)ro(  ess.  wnile  for  n  >  /> 
and  even,  the  set 


forms  a  standard  white  noise  pr-'cess. 

The  construction  of  /'and  the  chmees  of  points  forming 
the  sets  of  prediction  enors  in  proposition  4  I  represents 
one  particular  way  of  choosing  one  prediction  error  vector 
from  each  of  the  sots  described  betore  the  st.itement  of  the 
proposition. 

Pr<>of  of  Proposition  4. 1 :  VVe  locus  explicitly  on  the 
£'s.  as  an  analogous  proof  holds  for  the  F's.  Note  first 
that,  thanks  to  the  normali/ation.  all  ol  the  /,  ‘  variables 
do  have  unity  covariance.  Also,  thanks  to  the  sampling 


I!  n  }  H \\s  \(  HONS  ns  sius  \i  j'KO(}s^iN(,  vns 


N*  i 


dune  in  torniiny  ihc  sel.s,  il  !n  ^tniiehitdrujrd  to  cheek 
that  the  whiteness  will  be  proven  il  vve  van  show  that  tor 
n  >  p  (and  cither  even  or  oddi  the  unnormali/ed  predic¬ 
tion  error  is  unetirrelated  with  f.  ,,  „  (denoted  /■  ,  X 
,j )  tor  u  <  (land  tor  iv  o  0,  ul  >  n. 

Showing  that  this  is  true  lor  n  <  0  is  essentialU  the 
same  as  the  proot  in  the  lime  senes  '-ase  Speciticalls .  it 
A,  =  0  for  n  >  />,  then. 

I  il  >  l> 


so  that,  n  >  p. 

E  ,  1  '>j,,  .  ,  i4.:t 

by  definition  of  the  forward  prediction  errors.  Hence  from 
(2.9)  we  see  that  tor  n  ^  p. 

E ,.  -L  E«  »  for  u  <  0.  (4  .'^) 

Hence  it  remains  to  prove  that 

E  „  i  E,v  tbr  /  >  (4.4) 

This  proot.  which  involves  the  construction  of  isometries 
much  as  in  several  of  the  proofs  in  |l|.  is  sketched  in 
Appendix  C. 

For  a  time  series  model  the  constraint  of  eau.sulity  se- 
'•ercly  restricts  the  suppon  of  its  impulse  response.  For 
example  any  AR  time  .series  model  has  an  AR  impulse 
response  w'hose  support  is  the  nonnegative  intcgeis.  For 
processes  on  trees,  however,  there  is  considerable  flex¬ 
ibility  in  the  possible  choice  of  support  for  a  causal  im¬ 
pulse  response.  However,  as  the  following  states,  the 
constraints  of  isotropy  allow  us  to  determine  precisely  the 
support  for  AR  models. 

Proposition  4.2:  Lei  Y,  he  an  .4R  <  p)  isotropie  proeess. 
Let  us  write  the  formal  power  series  P,,  defned  in  (2.24) 
as 

P,.  -  ^  p„  ■  (4..“') 

r-  t 
w  «  » I 

Ifp  -  0.  p„  =  0  if  w  0,  If  p  1 ,  =  0  unless  le  = 
7  ''  for  some  k  >  0,  Ifp  2:  2.  then  p„  -  0  fir  all  words 
of  the  form  w  ~  y  *  „  ;  with 

!  t'  ! 

le,^.  e  {«.  d}*  and  !u-,„, !  >  :  -  |  -  1.  (4.6) 

In  other  words.  P^,  has  its  support  in  a  evlinder  of  radius 
1  p/?l  around  the  path  {y  ^  }  toward  ■■oo.  From  this  we 
also  have  that  the  modeling,  filter  of  an  AR  Ip)  proeess 
has  its  support  in  t.'..  same  <  vlinder  of  radius  |  p/2| 
arouiul  \t.  -00)  j/y  ‘  l  A  2:  ()}.  Conversed ,  anv  pro¬ 
cess  such  that  the  modelini;  filter  ha.':  its  support  eon- 
tained  in  the  cylinder  of  radius  1  p,/2|  is  neces.sm il\  an 
AR  I  p)  process. 

Comment:  The  proot  of  this  result  is  straightforward, 
although  tedious,  and  is  left  to  the  reader.  Fig.  6  illus- 
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hit  llluviraiiiit  t(ic  xvitniJcf  <'i  f.tJios  ft  isupra'ti  \k  ^  t 

hncE  s'>  liiuJci  r.uiiu'-  1  t  suppoH  t \K  t  ^  >  \K  ■  *  i  s,  ,,-1  j 

sh.Klcd  hncsi.  afiJ  vvimvicr  v>l  t.uluis  '  isuppi>Ei  h  .XK  '4;  XR  <*^1 

M'llJ  tla.  ^h.Kk■J.  .ind  cl.tNhcu  lifU'si 

(rates  the  evlinders  for  tow  order  AR  processes.  \oie  that 
proposition  4  2  is  a  generali/ation  of  the  result  m  1 1 .  ap¬ 
pendix  A|  which  states  that  it  an  isotropic  process  has  its 
suppon  concentrated  im  j/.  ooi.  then  it  is  necessarilv 
AR(h. 

B  Characterization  of  Rey.dar  (or  Piotlv 
Sondelerministic)  Pn n  esses 

Definition  4.1:  He  shall  say  that  an  isoirupa  pivni  ss 
T.  is  regular  or  pureh  nondetenninisin  it 

o’  >  0  (4.T’i 

holds,  where 


and  the  infimum  ranyes  over  all  (  (illi  ctions  of  siolars 
Oil  svhere  only  finitely  mans  of  the  n,  arc  nonzero 
and  the  condition  -  1  is  s.  tisficd. 

In  other  words,  no  non/cro  linear  combination  of  the 
values  of  Y,  on  any  given  horocycle  can  he  predicted  ex¬ 
actly  with  the  aid  of  knowledge  of  Y  in  the  strict  past. 
'Jj,.  ^  3-  and  the  asstieiated  prediction  error  is  umtormlv 
bounded  from  below  .  We  shall  now  churacten/e  regular 
proces.ses  in  a  fairly  simple  way  using  reflection  coefh- 
cients. 

Theorem  4.  I:  i)  The  fdloss  iny  firmulas  hold  for  cvers 
isotropie  process: 

a'  ~  lim  inf  X,,„(i;-,, ,  , )  (4.9i 

n  *  ir. 

If 

.  (  )  =  ri,(  I  —  A  1 )  I !  (1  •  A  ’ij.  .  5  ) 
r  I 

•  min  {I  +  A;,,  -  2A;',..  1  -  A-,,}  (4.10) 
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where  X,nt  Mi  denotes  the  sinullest  ei^envolue  nf  the  ma¬ 
trix  A.  and  ^  j  is  defined  in  Id.  IJ). 

Hi  An  isotropic  process  Y,  is  regular  if  and  onir  if  its 
reflection  coefficient  sequence  is  such  that  .  1 1  <  1. 
+  \ ,  and  furthermore . 

X 

L  (/;■'„  I  +  \k-„  \  )  <  ao,  |4. 1 1) 

M  •  I 

Comment:  I’he  corresponding  characterization  ot  reg¬ 
ular  processes  in  the  case  of  time  series  is  (cf..  for  in¬ 
stance,  12)): 

X 

t^„!  <  1  Vn,  ^  A'  <  oo.  (4.12) 

«  -  1 

Proof:  Note  first  that  the  singularity  of  the  process 
if  ‘  1 1  “  1  or  if  A„  =  —  1  /2  or  1  follows  directly  from 
the  resulting  degeneracy  of  the  prediction  error  covari¬ 
ance  (Theorem  3.3).  Condition  (4.11)  of  point  ii  is  an 
immediate  consequence  of  point  i,  since  for  k  small  ir  n 
[I  ~  k.  \  +  k  —  2k' )  —  1  -  lAj.  Thus  we  shall  only 
prove  i.  First,  let  us  prove  (4.9)  by  showing  that  a'  is 
both  >  and  <  the  right-hand  side  of  (4.9).  With  every 
(  '*1  definition  4.1  we  associate  a  sequence  of 

vectors  {M„)  of  increasing  dimension.  Specifically,  we 
begin  by  forming  an  infinite-dimensional  vector  by  order¬ 
ing  the  according  to  the  ordering  on  the  iv  o  0  defined 
in  (1,  sec.  Ill-A].  For  each  n  we  then  take  the  vector 
to  be  the  truncated  version  of  this  infinite  vector  by  keep¬ 
ing  only  the  initial  segment  consisting  of  those  s  such 
that  u’  is  involved  in  the  definition  of  E,  .  |.  We  then  set 
M„  =  M„/\\M„\\  if  M„  St  0,  and  equal  to  some  arbitrary 
unit  vector  otherwise  (here,  ii  '  •  •  II  denotes  the  usual 
Euclidian  norm). 

We  obviously  have 

M„  =  M„.  for /I  large  enough.  (4.13) 

Hence,  thanks  to  the  limit  theorem  for  square  integrable 
martingales  [8],  19],  we  can  write,  for  the  considered 
family  ( ) 


=  lim  |/W„ 

n  •  c© 


>  lim  inf  X,n,(E.„  .  i)  (4.14) 

n  *  00 

where  the  second  equality  uses  (4. 13).  and  the  inequality 
is  due  to  the  fact  that  M„  is  a  unit  vector.  Since  the  last 
expression  in  (4.14)  does  not  involve  the  considered  fam¬ 
ily  (m>J-  we  immediately  get  the  inequality  >  in  (4.9). 
Now,  fix  e  >  0  and  select  n„  large  enough  so  that 
X,„,(E,„.  .  |)  -  f  is  .smaller  than  the  right-hand  side  of 


t4.9).  Then,  lake  lor  M.,  a  unit  cigcioecli'i  o!  L  .  lo 
sociaied  w  ith  iis  smallest  eigeriv.iine  e  (heti  otn,  !!!  .‘oi 
lowing  inequahlics  which,  since  >  is  arbitrat'. .  MekK  ihc 
inequality  s  in  (4  9i: 

lim  inf  .  j  )  •  ( 

H  ’  '*■ 

X„,.(E;„  .  i  ) 

-  M!,  E  .  tM 

^  !|  -  u.  K,.  /;  I  U,  >.  'W  .  i 

where  )  is  the  famil)  .issociaied  with  4/ 

It  remains  to  prove  (4  It)),  Fsmg  (3  3Hi  i  3  4t)i.  wes.m 
write 


But  the  three  matrices  on  the  right  hand  side  of  tins  for 
mula  all  have  the  Haar  system  as  eigenvectors  id  |  i .  eq 
(4.19)1  Hence  we  can  diagonalize  all  ol  these  matrices 
simultaneously: 

A(E:,;!  ,-’)  -  .\(Ot .  ,).\(0'  ) 

A(E.-.,."  ,■')  0  \ 

0  Ad'-d,')/ 

holds,  where  A(.-1)  denotes  the  diagonal  matrix  ol  the  ei¬ 
genvalues  of  ,4.  Using  the  definition  of  0  ‘(A,  )in(3  32i. 
(3.33),  we  can  deduce  that 

A(E_'„ .  I )  =  diag  (1  -  A  v„ ,  |.  1  ■  •  •  !  i 

•  diag  (I  -r  A',  ~  2k].,.  1  -  A-,  I  -  •  ■  I) 

A(E;„  ,)  0  \ 

0  A(E:„  ,)/ 

so  that,  by  expanding  the  product  and  using  (3,36).  we 
finally  get  (4.10).  This  finishes  the  proof  of  the  theorem 
Note  that  the  condition  (4.11)  is  much  more  easily  vi¬ 
olated  by  a  valid  reflection  cocflicient  sequence  than  the 
corresponding  expression  (4,12)  fortune  scries,  pointing 
to  the  fact  that  there  is  apparently  a  far  richer  class  of 
singular  processes  on  trees  than  on  the  real  line  This  is 
apparently  related  to  the  characterization  of  spectral  mca 
sures  for  isotropic  processes  and  to  the  large  size  ol  the 
boundary  of  the  dyadic  tree  (see  the  comments  concerning 
11.  cq.  (2.33)). 

C.  A  Stability  Criterion 

A  well-known  result  for  all-pole  lattice  (ilters  is  that 
such  a  filter  is  stable  if  and  only  if  all  of  the  rellcction 
coedicients  have  magnitude  less  than  1 .  In  this  section  we 
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state  and  prtuc  riicineni  4.2.  whieli  is  iIk'  eoonterpan  oi 
this  result  lor  the  lattice  filters  introduced  in  this  paper. 
Before  stating  this  result,  let  us  clarifs  uhat  we  mean  In 
•■stability.”  Figs.  3-,^  depict  (fora  sixth-order  example) 
the  staieture  of  the  unnormali/ed  tilter.  This  tilter  de¬ 
scribes  how  the  computation  of  propagates  from  horo- 
cycle  to  horocyle,  with  f.',  (t'or/i  odd)  or  t/i,  '  ...  > 

(for  n  even)  as  input  and  the  corresponding  block  ot  >''s 
on  the  same  horocycle  as  output.  It  is  the  stability  of  this 
filter  that  we  wish  to  study. 

Theorem  4.2:  Uiuler  the  conditions 

-1  <  A,,  <  1  «  odd  1  <  /I  <  .V  (4.15) 

~\  <  k„  <  1  n  even  1  <  »i  •<  .V  (4.16) 

the  Xrh-order  unnonnalized  modeling  filter  sfteeified  h\ 
ld.23)-<J.27)  (.V  .Stahl e.  .so  that  a  hounded  input  F.,  \  t  for 
•V  (>dd  j  or  (E,  \.  \  .•  s )  !  for  S  even)  vield.s  a  hounded 

output  y,.  Similarly,  the  normalized  modelint>  filter  spec¬ 
ified  in  Theoretn  3.4  i.s  al.so  srahle  under  these  conditiinis 
so  that  a  hounded  input  E*^  t  for  ,V  odd)  or  lE. 
f'-w  '  -  s  )*  ( .f<»"  ‘S'  even)  yields  a  hounded  ouipia  YT. 

Proof:  Let  us  first  show  that  by  taking  advantage  of 
the  structure  of  the  filter  computations  we  can  simplify 
the  required  analysis  and  can.  in  fact,  reduce  it  to  a  ques¬ 
tion  of  stability  analysis  for  a  standard  temporal  sy  stem. 
To  begin,  in  Fig.  7  we  have  depicted  one  (d  the  two  par¬ 
allel  computations  depicted  in  Fig.  5.  where  we  have  u.sed 
notation  that  emphasizes  the  sequential  nature  of  the  com¬ 
putations.  Here  the  indices  "m"  and  "m  -  I"  index 
horocycles  .so  that  the  "m  ~  1”  quantities  are  stored  and 
the  “m"  quantities  are  computed  from  the  input  (£,.|  (/«). 
£h;(/n))  which  is  distinguished  by  a  solid  box  at  level  6 
in  the  figure  (note  that  the  reverse-going  output  from  this 
final  level,  £hi  (m)  is  distinguished  by  a  dashed  box).  The 
subscripts  for  the  signals  in  Fig.  7  code  the  various  error 
and  output  processes  at  each  level.  The  first  subscript  for 
the  £  and  £  vectors  indicate  the  order  of  the  error  xector. 
while  the  second  subscript  (and  the  only  subscript  for  the 
F's)  indexes  the  vectors  along  a  segment  of  a  horocycle. 
The  precise  corrc.spondencc  between  the  nomialized  ver¬ 
sion  of  quantities  in  Fig.  7  and  those  in  Fig.  5  car  be 
directly  determined  by  matching  up  signals  and  node  in¬ 
dices  in  Fig.  5  with  signals  and  horocycles  index  (m  and 
m  —  1)  in  Fig.  7.  For  example. 

Y,.  Y,f,.  Y,^.:,.  Yfm).  Ydm).  Yum).  Y^tm) 

Y,.,  ;.  Tvs  ,  i  F|(/?;  -  1),  Y.lm  -  1) 

£,  ,.  £„v;  1  E^i(m).  E.fm) 

£,,4.  £,V  '  4  (£41  (w).  Eidm)). 

As  we  emphasized  in  .Section  IH-A.  and  as  illustrated 
graphically  in  Figs.  3-5  and  7.  each  stage  of  the  compu¬ 
tation  is  pyramidal  in  structure.  For  example,  the  state  of 
a  set  of  nodes  at  a  given  horocycle.  together  with  the  in¬ 
puts.  provide  the  state  at  two  descendent  sets  of  nodes  at 
the  next  horocycle.  Since  the  computations  in  generating 


each  ot  these  descendent  sets  alc  idcmic.il  m  striKUnc 
we  need  lollow  oiiK  one  o!  these  [i.iths  m  order  to  es 
amine  stabilits  For  exanqile.  lot  our  sicth utiler  ex.im 
pie.  we  need  only  esiablish  si.ibilny  ot  the  dyiuimu  -  troni 
input  (/•.,,,  t/n).  £,■  Inn  )  to  ()',  (w ),  )i/;n.  ).un\.  I.inni 
Howe\er.  we  can  lake  I  his  considerably  1. in  her  In  (vir 
ticular.  because  ol  ihe  pyramidal  symmetries,  we  need 
only  consider  the  stabiliiy  ot  ilie  map  trom  (/,  s/m. 
F.A-t/n))  to  F,(w)  as  the  stnicture  ot  ihe  map  to  fmn. 
>';(//().  and  >4(/)n  are  identical.  .More  generally .  si.irimg 
from  any  node  1,,  on  the  tree,  we  need  only  consider  ihe 
stability  of  the  dynamics  msoKed  m  generating  j  }  1/ 

>  ()},  since  the  dynamics  tor  any  other  path  trom  tioro 
cycle  to  horocycle  has  identical  structure 

I'sing  the  notation  of  Fig.  7.  we  now  sec  ihai  we  imisi 
examine  the  stability  ol  the  system  ilhistraied  m  Fig  is 
for  the  sixth-order  case,  cohere  the  small  solid  squares  now 
denote  standani  .-  '  operations  ii  e..  Mm)  ow 
1)).  Here  the  .V(A,, )  matrices  are  exactly  as  detined  in 
Theorem  3.2  V\'e  can  now  apply  standard  time  domain 
methods  to  this  system." 

Note  tirsi  that  under  conditions  i4  15i.  (4.16).  the 
0(A,, )  matrices  detined  in  Theorem  3  3  and  the  coxari 
ance  matrices  T,  are  inxertible  so  that  we  can  equivalently 
study  the  stability  of  the  normalized  form  of  the  modeling 
filter.  Note  also  that  checking  that  a  sysiem  function  Hiz) 
has  all  its  poles  strictly  inside  the  unit  circle  is  equivalent 
to  checking  the  same  condition  for  the  system  function 
Hiz' ).  Thus  to  test  for  stability  we  can  modify  the  system 
of  Fig.  by  adding  a  unit  delay  in  every  iefi-io-nght- 
going  path,  and  by  replacing  the  Stk  )  blocks  by  the  sc.n- 
tering  matrices  12  (A. )  of  Theorem  3.4.  For  example,  in  the 
sixth-order  case  we  can  equivalently  check  the  stability  of 
the  system  in  Fig.  9  Recall  that  for  an  .\fh-iirder  tilter  we 
proved  in  Theorem  3.4  that 

UtAyl'iTtAT  -  /.  ,  4::  I.  •  ■  ■  .  ,V  (4.17i 

for  any  set  of  coelficients  Ay.  ■  •  ■  .  Ay  that  are  retlection 
cvrelticicnts  of  some  isotropic  process.  But  the  entries  of 
the  matrices  i2(A,  )'I2(A,  )-/,/=  1  .■■■  .  .V  are  rational 
functions  of  the  A„'s  that  have  no  poles  inside  the  domam 
specified  by  the  convlitions  (4. 15).  (4. 16).  Hence  we  may 
use  the  Lemma  C.2  of  .Appendix  C  to  exleitil  the  property 
(4.17)  to  the  whole  domain  specified  by  the  conditions 
(4.15).  (4.16). 

Using  (4. 17)  and  the  notation  of  Fig.  4  we  h.ive  that 
ii^,(ni)l-"  'irj, (/)))!■' 


,  .  1  ( n; 

-  1)T 

V  ^  1  On  - 

1  h 

(4.18) 

the  boundary 

conditions 

Av  ■  1 

On)  ■ 

//On) 

i4  Id) 

!jidm)  - 

ii(n/  '  1) 

(4  20) 

Tv)  study  stability  we  set  uim)  s  ()  and  define  the  follow  - 

‘Wc  woiilil  hko  at.’kfu>u  ii’tlgo  H  (  '  I  caa  l"i  MiutcO'-tiui:  luu-  I'l 

pnn)! . 


BASSKVll.l  1-:  ,/  J  Ml'LTISCAl.H  AR  PROC  l.SSt  S.  CAR  I  II 


I— ^ — I 

?Em(fB)  ?E42(rQ)  'F4i<nv 

(’E3itin))  (fE)2<“»> 

?F2i(ro-l) 

cAd  cA 

?E3i{in)  IFjtlm)  7E32^®I  'Fjilml 

(’E2,(in))  ('Ealm))  (lEijdn))  (lEi,(m)) 

"’Fnlnvl)  IF'lllmll 

(A)  J\ 

I’Ejldni  '’E22(ro)  ’Eulni)  ?E24(nD 
'Fill®)  IFzjIm)  'Fj3(ai)  ’Fjidn) 

('Eiidrt)  (!E|j(iK»  CEijIn#)  (’Ei4<n#) 


(A)  A 

7En<oi)  ?Ei]<id) 

!Fji(tB)  ?Fi2(in)  !Fi3(®)  lFj4(n*J 

?Y2(tn)  iVidn)  ?Y4(m) 

Fig.  7.  Illustrating  one  of  the  iwo  parallel,  scquenlia!  computauons  k»r  ihc  model  ol  Fjgs  7 


r6ilm)  F5](fn)  F4i(m)  Fji(nt>  hjilm}  T-u(m) 


Fig.  8.  Illustrating  one  computational  path  from  horocycle  to  horocyclc.  It  is  this  standard  imic  d<unain  ''\stcm  ’ivhtisc  siahsht) 

is  equivalent  to  that  of  the  unnomiali/ed  modeling  filter 


n<jlm)  T\^m]  ru(m)  Tt,(m)  n^m)  nilm)  nrfrpl 

Fig.  y.  F'qiJivaleni  system  whose  stability  is  investigated  in  the  proof  ot  Thei^rem  4  2 


ing  positive-definite  function  of  the  state  of  the  system 

V 

V(m)  =  H  !U,(m)!l"  +  Ik,  i(w)|k  (4.21) 

I  ■  1 

Then  from  (4. 1 8)-(4,2 1 )  we  obtain 

V(m)  -  V{m  -  1)  =  -  lkv4w)lP-  (4.22) 

It  can  be  readily  checked  that  the  system  is  observable 
from  rjv(m),  as  long  as  (4. 15)  and  (4. 16)  arc  satisfied,  so 
that  y(m)  is  a  Lyapunov  function  proving  asymptotic  sta¬ 
bility. 


D.  Every  Finite  Family  of  Reflection  Coefficients 
Defines  an  isotropic  AR  Process 

Our  analysis  to  this  point  has  shown  how  to  construct 
a  sequence  of  reflection  coefficients  {4,,}  Ifoni  an  iso¬ 
tropic  covariance  sequence  {/„}.  Funhennore.  wc  have 
seen  that  the  {/.„}'s  have  particular  hounds  and  that  if 
{r,,}  comes  from  an  AR  ( p)  process,  only  the  first  p  of 
the  reflection  coefficients  are  non/cro.  The  following  re¬ 
sult  states  that  the  converse  holds,  i.c..  that  any  finite  k„ 
sirquence  satisfying  the  required  constraints  corresponds 
to  a  unique  AR  covariance  sequence.  Tins  result  suhstan- 
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Ualo>  Diir  previous  stalcnien!  that  the  relleeiioii  eoclh- 
cients  provide  a  eotxl  parameteri/.ation  ot  AR  proeesses. 

Tlu'iuem  4.3:  Civcn  a  fiiiilf  .wtiiicnct'  of  rvficctit»i  ciwf- 
ficii’iiis  A,,.  1  <  n  <  p  such  that 


\  -  \<  h„<  \ 

C  -  1  <  A,,  <  ] 


for  u  even 
for  II  odd 


(4.23) 


then’  c.xisrs  a  unique  isotropic  covariance  scijucncc  which 
has  as  its  rcjieciion  coefficient  sequence  the  ffiven  k,,  fol¬ 
lowed  by  all  zeros. 

Proof:  Consider  the  modeling  filter  of  order  p  spec¬ 
ified  by  the  given  set  of  reflection  eoefiicients.  What  we 
must  show  is  that  the  output  of  this  titter  y,  is  well  defined 
(i.e..  has  finite  covariance)  and  isotropic  when  the  input 
is  a  standard  white  noise  process.  That  it  is  well-defined 
follows  from  the  stability  result  in  Theorem  4.2.  Thus  we 
need  only  show  that  y,  is  isotropic.  More  specifically .  let 
(.?,  1)  and  (.s',  /  ')  be  any  two  pairs  of  points  such  that 
d(s.  t)  =  d(s' .  t' ).  The  theorem  w  ill  be  proved  if  we  can 
show  that  the  function 

4>;  K  =  (A,,  )i ^ i(.v,y, )  -  P(y,  y,  )  (4.24) 

is  identically  zero  for  all  A„"s  satisfying  the  condition 
(4.23).  But  the  formulas  for  the  modeling  filter  (Theorem 
.3.2)  show  that  is  a  rational  function  of  A"  which  is  an¬ 
alytic  inside  the  domain  specified  by  the  conditions  (4.23). 
Also  <i>  is  identically  zero  for  all  sequences  K  arising  from 
valid  isotropic  covariances  via  the  Schur  recursions 
(2.26)-(2..31).  Then  the  theorem  is  an  immediate  conse¬ 
quence  of  the  Lemma  C.2  of  Appendix  C. 


V.  CoNCl.t'SION 

In  11|  and  this  paper  we  have  described  a  new  frame¬ 
work  for  modeling  and  analyzing  signals  at  multiple 
scales.  Motivated  by  the  stnicture  of  the  computations  in¬ 
volved  in  the  theory  of  multiscale  signal  representations 
and  wavelet  transforms,  we  have  examined  the  class  of 
isotropic  processes  on  a  homogenous  tree  of  order  2. 
Thanks  to  the  geometry  of  this  tree,  an  isotropic  process 
possesses  many  symmetries  and  constraints.  These  make 
the  class  of  isotropic  autoregressive  processes  somewhat 
difficult  to  describe  if  we  look  only  at  the  usual  AR  coef¬ 
ficient  repre.sentation.  However,  as  we  have  developed, 
the  generalization  of  lattice  structures  provides  a  much 
better  parametrization  of  AR  processes  in  terms  of  a  se¬ 
quence  of  reflection  coefficients. 

In  developing  this  theory  we  have  seen  that  it  is  nec¬ 
essary  to  consider  forward  and  backward  prediction  errors 
of  dimension  that  grows  geometrically  with  filter  order. 
Neveithcless,  thanks  to  isotropy,  only  one  reflection  coef¬ 
ficient  is  required  for  each  stage  of  the  whitening  and 
modeling  filters  for  an  isotropic  process.  Indeed  as  shown 
in  |]  |.  isotropy  allowed  us  to  develop  a  generalization  of 
the  Levinson  and  Schur  scalar  recursions  for  the  local 
averages  or  baryccnicrs  of  the  prediction  errors,  which 
also  yield  the  reflection  coefficients.  In  this  paper  we  have 
justified  our  claim  that  the  reflection  coefficients  are  a 
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good  parametrization  for  AR  processes  and  isotropic  pro¬ 
cesses  in  general.  In  particular  we  have  developed  whit¬ 
ening  and  modeling  filters  for  AR  processes  that  can  be 
completely  specified  in  temis  of  these  coethcienis.  In  ad¬ 
dition  we  have  shown  that  there  is  a  one-to-one  corre¬ 
spondence  between  linife  reflection  coefficient  sequences 
and  .AR  processes,  have  characterized  the  stability  ol  lat¬ 
tice  filters  in  terms  of  the  reflection  coeliicients  and  have 
shown  how  the  regularity  of  an  isotropic  process  can  he 
characterized  in  terms  of  its  reflection  coefficient  se¬ 
quence 

This  work  represents  one  pan  of  a  larger  eflon  to  de¬ 
velop  a  theoretical  foundation  for  multiscaie  statistical 
signal  processing.  In  particular  in  |1()1  we  investigate  a 
weaker  notion  of  multiscale  stationarity  which  leads  to  a 
state  space  and  system  theory  for  multiscaie  modeling  and 
a  corresponding  methodology  for  scale-recursive  optimal 
estimation  which  accomodates  very  naturally  the  fusion 
of  data  from  sensors  with  different  resolutions  |31-  |.‘s  j.  The 
multiscale  AR  models  dcveh.ped  here  as  well  as  the  state- 
space  models  of  |31-(S|  are  particularly  useful  for  mod¬ 
eling  and  analyzing  signals  displaying  fractal-like  or  self¬ 
similar  characteristics.  For  example,  vvhen  restricted  to  a 
given  level  of  resolution,  a  sample  of  an  isotropic  process 
can  be  drawn  like  an  ordinary  signal.  We  show  in  Fig,  10 
a  sample  of  an  AR  (3)  process  with  k,  ~  A-  --  At  0.49. 
Figs.  1 1  and  12  show  approximations  of  this  signal  at  suc¬ 
cessively  coarser  scales  using  the  multiresolution  analysis 
via  wavelets  of  Mallat-Daubechies,  as  presented  in  17| 
These  approximations  display  the  self-similar  statistical 
characteristics  we  expect  of  this  class  of  models  (sec  also 
the  thorough  development  for  so-called  1  /-processes  in 
!ll).|121). 

There  are  several  promising  directions  for  further  re¬ 
search  building  on  our  fonnalism.  In  particular,  an  essen¬ 
tial  topic  for  investigation  is  the  development  of  methods 
for  constructing  isotropic  AR  models  directly  from  data 
as  available  in  practice.  This  requires  identifying  multi- 
scale  structure  and  estimating  isotropic  covariance  se¬ 
quences  from  data  restricted  to  a  single  scale,  i.e,.  a  sin¬ 
gle  horocyclc  [bl.  In  addition,  we  expect  that  these  models 
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Fi^  1 1 .  The  ^1alla^-Dallhcchle^  rnuliirosolution  appnmmaiuwi  ol  the  Mg 
nal  ol  Fig.  10. 
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Fig.  12.  The  Mallat-Daubechlcs  niultireNoluiion  approximation  ol  the  sig¬ 
nal  ot'  Fig.  10,  continued. 


.should  be  of  value  for  segmentation  of  signals,  and.  in 
two  dimensions,  for  the  identification  of  textures,  based 
on  differences  in  multiscale  characteristics.  The  scale-re¬ 
cursive  structure  of  the  AR  whitening  filter  should  facil¬ 
itate  the  calculations  of  likelihood  ratios  much  as  in  or¬ 
dinary  time  series  analysis.  Work  in  these  areas,  as  well 
as  on  several  applications  of  our  theory .  is  proceeding  and 
will  be  reported  in  the  future. 

Apph.ndi,x  a 
Umbujcal  Lf.mma 

We  shall  use  the  following  notation; 

vvF  =  K,„. 

where  w  is  a  word.  Note  that  we  have 

t’F.,  =  Fur  =  H7'K,. 

Furthermore,  in  the  sequel,  \q\  denotes  the  greatest  inte¬ 
ger  smaller  than  q.  and  we  shall  write,  for  short.  6'*'*  in¬ 


.stead  i>f  6*''''',  Using  these  notations,  we  base  the  follow 
mg  result. 

l.emimi  A.  I.  For  each  n.  the  /o/A/nme  huid 

'i  'F  ,,  -  iV"' '  ''  'F  .  up  to  .1  pcnmitaiu'i) 
Proof:  Recall  that,  tor  u  <  0,  u  i  n 

F.  „("  )  U,.  -  Fa  y;,, '  'M.  ,,  ,  ) 

whence 

y  =  y;,  „  i-a).,  ^  ‘Mr,  .  :  > 

and 

y  '/y, 

-  y;„;....  :r,  -  FtK..r  .  ,  „  'Mr  . 

so  that,  to  prove  the  lemma,  il  is  enough  to  show  the  fol¬ 
lowing  formulas: 

|n'!  =  n.  u  '  =  -Me  S3  ae'  -  u  (.4  !) 

i>ii  <  n  ~  1.  ve'  -  'Ml  =■  Ol  '  <//■!. 

(A. 2) 

Proof  of  (A.  I ):  Set  u  =  y  A'‘  ‘.  /  -  2A  -  n.  Then 

tt  ■  =  y  'A'-'"  ■'  '  0“' 

where  .v.  =  max  (.v.  0).  To  prose  (.A.  1 )  it  sutiices  to  \cr- 
ify  that 


holds  in  (A, 3).  which  amounts  tt'  verify  that  it  >  |(;i  - 

1)/21  +  k.  and  this  is  a  ct'nscqucnce  I'f  the  inequalities 
k  <  («/21  and  u  >  |u  21  |(n  -  1)  2). 

Proof  of  (A.  2):  Again  set  le  =  y  (S  '‘  .  I  +  2k  ■<  n 

-  1.  Then  o'  "  "  Now  if  A  2  !(n  -  li  21 

-  /holds,  then  (A. 2)  ft'llows.  Otherwise  /  2(1*;  -  1  2) 

-  /)  =  2  |(u  —  1)/21  -  /  <  u  -  1  also  proves  (A. 2). 

Appi  ndix  B 
Proof-  oi  (4.4) 

Take  any  /  >  n/2.  Suppose  that  we  can  find  as  an 
isometry  'P:  3  .1  so  that 

1)  'kU)  =  r. 

2)  maps  the  set  (ty  '>e|u  <  (1,  Mt  i  <  //  -  h}  onto 
itself. 

3)  'P  maps  the  points  {m' }  U  {m  'y  'uiie  <  0,  ;ii) 
<  ti  -  1 }  onto  a  set  of  poiiie.  each  t'f  w  hich  is  < 

I 

/y  . 

Let  y*  ~  y'+i,i  and  define  F*  similarly .  fhen.  thanks  tt' 
isotropy.  )'*  has  the  same  statistics  as  Thus  Irt'm  (4  2) 

F-'r,,  -L  'M*  (B.i) 

However,  thanks  tt)  prt'peilies  1 1 )  and  (2)  of  'p 

/y  „  -  Fl: 
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Fig.  1-V  Illustrating  the  isomctrs  used  m  Appendix  A  for  the  ease  ii  =  5  and  t  -  .V  Here  the  punt  point  is  r,  .  so  itui  the 
pan  of  the  tree  toward  t  from  !■>  is  left  unchanged  The  ’  rotation"  exchanges  the  points  r,  ‘  and  r,  h  and  maps  then 
.successors  accordingly.  The  set  of  nodes  indicated  with  ,  which  is  in  this  case  both  |i-,  '  iv  u  ■  (1.  n  s  n  II  .nid 
{/5'y  '  icliv  0,  lui  <  ;i  -  I  }  is  left  invariant  by  this  isometry  .  Also  the  point  is  mapped  unto  one  ot  the  imniediaie 
successors  of/-,  '  6,  both  of  which  are  ‘. 


while  thanks  to  property  (3)  and  (2.9) 


and  we  let  S  denote  the  .set  of  such  vecittrs  so  that 


6  JClr*  iju’^0}.  (B.2) 


-  1  <  k:„ .  1  <  +  1 


Equations  (B.l)  and  (B.2)  then  imply  (4.4). 

The  required  isometry  is  of  the  pivot  type  used  in  the 
proofs  in  [1,  appendix  C|.  As  illustrated  in  Fig.  13.  the 
pivot  for  this  isometry  is  the  point  ty  ■  and  the  di¬ 
rection  of  ■‘rotation”  is  as  indicated  in  the  figure.  It  is 
straightforward  to  check  that  this  isometry  has  the  re¬ 
quired  properties. 


Appfnd/x  C 
Some  U.sefue  Lemmas 


The  first  lemma  is  an  immediate  consequence  of  the 
Schur  recursions  (22.6)-(2.3 1 ); 

Lemma  C.  I:  Consider  the  transformation  'k  which  maps 
an  isotropic  covariance  sequence  {r„ }  to  the  correspond¬ 
ing  reflection  coefficient  sequence.  The  Jacobian  of  this 
transformation  satisfies  the  following: 


=  0 


for  <  m 


Sk2„ 

bri„ 


1 


2" ' 


,(0) 


^  0 


(C.l) 

fC.2) 


<  k:„  <  +1. 

Lemma  C.2:  Consider  a  function  ^  from  /?’’  into  R  sat¬ 
isfying  the  following  properties: 

1)  ^{K)  -  0  if  K  is  the  reflection  coefficient  sequence 
of  an  isotropic  process. 

2)  <J>  is  analytic  inside  S. 

Then.  4>  =  0  /n  8. 

Proof:  Since  4>  is  analytic  in  S,  it  is  sutficieni  to 
show  that  is  zero  on  a  set  with  nonempty  interior  in  S. 
Since  we  know  that  <t>(/0  =  0  if  A'  is  in  the  image  of  the 
map  ^  introduced  in  Lemma  C.  I .  it  is  sufficient  for  us  to 
show  that  the  image  of  has  a  nonempty  interior. 

Thanks  to  the  fomi  of  the  Schur  recursion  formulae 
(2.26)-(2.31 ).  we  know  that  Sk  is  also  a  rational  function 
and.  thanks  to  Lemma  C.  1 .  its  Jacobian  is  triangular  and 
always  invertible.  Thus  it  is  sufficient  to  show  that  the  set 
of  finite  sequences  {r„|0  <  n  <  /V }  that  can  be  extended 
to  a  covariance  function  of  an  isotropic  process  has  a  non¬ 
empty  interior.  However,  this  property  is  characteri/ed  by 
a  finite  family  of  conditions  of  the  fomi 

("Hfr,,.  •  •  •  .  r,,)  >  0  (C.4) 


<^kz„ .  I 
, , 


1 

2““(p:;(0)T'^'Wi7()T)  ""  ^ 


where  the  P„  are  the  Schur  series  defined  in  (2.26). 

Next  we  write  K  -  (k„),  „ .,  ,,  to  denote  a  vector  in  R''. 


where  (Hfr,,.  •  •  ■  ,  r,, )  denotes  a  matrix  whose  elements 
are  chosen  from  the  r,,.  •  •  •  ,  r,,.  The  set  of  I  p  +  1 1- 
tuples  satisfying  these  conditions  with  strict  inequality  is 
nonempty  (for  instance,  r„  =  O,,,,  is  the  covariance  sc 
quence  of  white  noise)  and  as  a  consequence  the  set  of  r„. 
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•  •  •  .  satisfying  (C.4)  has  a  nonempty  interior.  This 
finishes  the  proof  of  the  leninui, 
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